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(57) Abstract: A web inspection system provides detection of web flaws along the machine direction and cross direction of a web. 
The detectable percent contrast between good web material and bad web material in one embodiment approaches noise level. The 
web inspection system utilizes a multiple of smart cameras connected to a host computer via an ethernet hub. Each smart camera 
includes a line scan camera for producing digital pixels, a means for lighting and pixel correction on a pixel by pixels basis, a web 
edge detector for monitoring the edges of a web, a multi-pipeline flaw detection pre-processor for detecting very small changes in the 
web material, a run length encoder for generating data regarding the location of each group of potential flaws in a cross direction, a 2D 
blob detector and analyzer for generating data regarding the location of block flaws along a machine direction, and an inspect/reject 
analysis for determining the actual flaw data from the potential flaw data. A low contrast web inspection system provides a balanced 
and distributed architecture that handles high defect rates, and that is easily integrated with an existing web manufacturing system. 



WO 02/065107 A2 I Hill III III 1 1 II 1 1 1 1 III I II I II 1 1 1 1 III I II 1 1 III II I II 1 1 1 1 1 II I II I II II II I II 1 1 II II 



For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



WO 02/065107 



PCT7US02/01863 



-1 - 

WEB INSPECTION SYSTEM 
BACKGROUND OF THE INVENTION 

5 Field of Invention 

The present invention relates generally to web inspection systems and 
more specifically to smart camera systems for detecting flaws and defects of 
web material. 

10 Background 

A "web" is a flat material produced continuously in large quantities and at 
very high rates. Typical web materiel includes fabrics, sheet metal, paper, and 
non-woven plastic, etc. Inspection of the web material surface is required during 
production to find flaws and defects. Failure to detect these flaws and defects 

15 may result in thousands of feet of unusable web material. Thus, there exists 
varying methods of web inspection from manual inspection and sampling to 
image acquisition, processing and analysis. 

Figure 1 illustrates a traditional system 1 0 for web inspection utilizing line 
scan cameras 22 positioned above a web 12. Typically, two types of sensor 

20 technology, charge coupled device (CCD) or CMOS, are utilized. While CMOS 
technology allows the signal processing electronics to be on the same chip as 
the sensor, CCD sensor technology offers advantages superior imaging quality 
as compared to CMOS sensors, and stand alone components. Continuing with 
Figure 1 , high bandwidth camera-specific data cables 34 are required to transfer 

25 data from the line scan cameras 22 to a vision processor 32. A typical high 
bandwidth data stream transfer is forty (40) million pixels per seconds, i.e., 500 
Mbits per second for pixels of eight (8) bits. 

The megapixel data stream is transferred over the camera-specific cables 
34 to frame grabber modules 24 in the vision processor 32. Frame grabber 

30 modules 24 utilize standard integrated circuit (IC) boards to digitize an analog 
video stream image from a line scan camera 22. The digitized images, 
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represented by arrays of numbers, are streamed to pipeline vision processors 
26 for real time preprocessing. The pipeline vision processors 26 utilize 
dedicated image processing boards for data and image analysis that may be 
different for various webs. For example, a pipeline vision processor 26 may be 

5 configured to extract specific information from an image. The processed images 
from each of the pipeline vision processors 26 are sent to an image analyzer 
processor 28 that further analyzes and processes an image of the full width of 
the web 12. The web inspection system 10 of the prior art may further include 
an image buffer board 30 for data storage. The vision processor 32 of the prior 

10 art requires a large chassis to house the IC boards of the frame grabber modules 
24, the pipeline vision processors 26 the image analyzer processor, and the 
image buffer 30. 

The processed image from the vision processor 26 is sent to a host 
computer 14 for display on the graphical user interface (GUI) of the host 

15 computer 14. Also connected to the host computer 14, is a defect marker 18 
and an encoder 1 6. The encoder 16 sends information to the host computer 14 
including the speed of the web 12. The web 12 typically moves over a rotary 
device driven by a shaft and roller that produce pulses per unit distance. The 
host computer 14 utilizes this information to determine the size and position of 

20 a defect. The host computer 14 may also include a database input/output board 
to control a defect marking system 18, and other peripheral device connections 
20. 

The web inspection systems 10 of the prior art present several 
disadvantages. As described above, prior art web inspection systems 10 require 

25 a high number of components that are supplied by many different manufacturers, 
thus presenting compatibility problems. Integration of the components is difficult 
and expensive, and the resulting system is often difficult to configure and use. 
The prior art web inspection systems 10 typically have large footprints and 
require racks or large custom boxes of boards for parallel processing. These 

30 extra racks of equipment and the operator console, or host computer 14, must 
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be out on the floor and relatively close to the web equipment 12 due to the 
constraints on the length of connecting cables which must transmit a large 
bandwidth of data. For example, custom shielded cables are required to connect 
components to protect the video signal from picking up background noise. The 
5 requirement of proprietary cables and the large bandwidth transmission of the 
high speed raw image data from the cameras limits and/or preempts the use of 
standard factory ethernet cables to link all components and factory computers. 

A further disadvantage of the prior art web inspection systems 10 as 
shown in Figure 1 is the low mean time between failure due to the number of 

1 0 components. In addition, a web inspection system 1 0, as shown in Figure 1 , is 
an unbalanced architecture, meaning that one component in the system often 
limits the performance of the system. For example, high speed data sent over 
cables 34 may jam processing in the vision processing box 32. Also, high defect 
rates may cause overload occurrences in the image analyzer processor 28. 

15 Expansion of an unbalance architecture to add more capability is usually very 
expensive, and the system 10 is often already maximized, e.g. the rack holding 
the equipment cannot accept more boards. Another drawback of the non-robust 
web inspection system 10 of the prior art is that the system 10 is not easily 
scalable. Therefore, if a customer requires the detection of defects that are half 

20 the size that the current system 1 0 is capable of detecting, more cameras may 
be added, but the system 1 0 cannot be configured to accept more pipeline vision 
processors 26 and/or a second image analyzer 28. 

Thus there exists a need for a balanced and robust web inspection 
system that is easily integrated with an existing manufacturing Ethernet, and is 

25 capable of detecting a high rate of web flaws and defects. 

SUMMARY OF THE INVENTION 

It is an advantage of the present invention to provide smart cameras for 
processing images at the front end of the system to limit the bandwidth required 
30 to transmit image data. 
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It is a further advantage of the present invention to provide a robust web 
inspection system that is capable of expansion. 

It is another advantage of the present invention to provide a web 
inspection system that may be connected to an existing factory ethernet. 
5 It is yet another advantage of the present invention to provide a web 

inspection system that can be readily expanded as required. 

It is yet another advantage to provide a low contrast web inspection 
system that is capable of detecting flaws and defects in web material that are 
close to the noise level. 

10 Still another advantage of the present invention is to provide a web 

inspection system that requires a limited number of components thus increasing 
the mean time between failure of the web inspection system. 

The present invention also provides a balanced architecture for 
processing data that results in predictable response and more robust behavior. 

15 In an exemplary embodiment of the present invention, a web inspection 

system includes at least one smart camera for generating digitized images of 
portions of a web material having a flaw or defect. Each smart camera is 
connected via an ethernet hub to a host computer. The host computer and a 
web encoder monitor the web speed and send control signals to the each smart 

20 camera. Each smart camera is connected to a marking system for marking the 
web proximate to each flaw or defect with corresponding codes or other 
markings. In an exemplary embodiment each smart camera includes a head 
board for capturing an image of a portion of a web, and digitizing the image, a 
processor for analyzing the image, an input/output board for controlling the input 

25 and output of the image data signals, and a power supply board for supplying the 
smart camera components with required voltages. 

In an exemplary embodiment of the present invention, the smart camera 
is capable of detecting very small flaws and defects of the web, i.e. the contrast 
between a flaw and good web material is close to a noise level. The smart 

30 camera of the exemplary embodiment includes all signal processing devices, 
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and only web flaw information and flaw images are sent to the host computer. 
However, the smart camera is capable of sending any portion of the real-time 
web image during periods of low bandwidth usage, e.g. when the number of web 
flaws is minimal. 

5 The smart camera of the exemplary embodiment includes a line scan 

camera, a lighting uniformity correction and pixel sensitivity correction circuit, a 
web edge detector circuit, a multi-pipeline flaw detection pre-processor, a run 
length encoder, a two dimensional blob detector circuit, a two dimensional blob 
analyzer, and an inspect/reject criteria analyzer. The line scan camera supplies 

10 a digital video stream of the web to the lighting uniformity correction and pixel 
sensitivity correction circuit. Each pixel of the digital video stream is corrected 
or adjusted according to a pre-determined baseline. The web edge detector 
determines the location of the edge of the web, and transmits the web edge data 
and corrected digital video stream to the multi-pipeline flaw detection pre- 

15 processor. 

The multi-pipeline flaw detection pre-processor of an exemplary 
embodiment includes programmable two dimensional filters including a 
background filter, a machine direction streak filter, a cross direction streak filter, 
and a small flaw filter. Each filter determines an average pixel value along a 

20 portion of the web. The average pixel value, which is constantly updated, 
becomes a reference for an adjacent portion of the web. The multi-pipeline flaw 
detection pre-processor also includes four adaptive background subtraction 
channels that subtract the averaged background from the corrected digital video 
stream, the output of the machine direction streak filter, the output of the cross 

25 direction streak filter, and the output of the small flaw filter. In the exemplary 
embodiment, four multi-group thresholders group pixels for each adaptive 
background subtraction channel. The four multi-group thresholders include a 
single pixel flaw detector, a machine direction streak detector, a cross direction 
streak detector, and a small flaw detector. A fifth multi-group thresholder 

30 uniformity detector groups pixels for the output of the background filter. The 
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outputs of the multi-group thresholders are video signals that include potential 
web flaw data. These signals are sent to a priority logic circuit of the multi- 
pipeline flaw detection pre-processor to prioritize the signals according to 
programmable thresholds and rules. 
5 The prioritized signal from the multi-pipeline flaw detection pre-processor 

is sent to a run line encoder to determine the start and stop pixels for the 
detected web flaws. A two dimensional blob detector and analyzer perform a 
connectivity analysis on the continuous stream of prioritized signals to determine 
whether groups from a same flaw class touch to form blobs, i.e. two dimensional 

10 areas of flaw. The resulting output data from the blob analyzer and the 
prioritized signal is then analyzed by a programmable inspect/reject criteria to 
determine whether the detected blobs rise to the level of a flaw. The output from 
the inspect/reject criteria analysis, which includes video and control data, is 
output from the smart camera to the host computer. 

15 In the exemplary embodiment of the present invention, the host computer 

records and displays the flaw information, including an image, location 
information, and the class of the flaw. The host computer may also request real- 
time video of the web as permitted by the availability of system bandwidth. The 
host computer of the exemplary embodiment performs trend analysis on the 

20 detected web flaws to determine whether any particular web flaw is occurring at 
a regular interval at a same location on the web. The detection of a regularly 
occurring flaws may indicate specific problems with the web manufacturing 
equipment. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be better understood from the following detailed 
description of a preferred embodiment of the invention, taken in conjunction with 
the accompanying drawings in which like reference numerals refer to like parts 
and in which: 
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Figure 1 is a block diagram of the traditional prior art web inspection 
system; 

Figure 2 is a smart camera web inspection system of the present 
invention; 

5 Figure 3 is a block diagram of a preferred embodiment of a smart camera 

of the present invention; 
Figure 4 is a block diagram of a high contrast web inspection system of 

the present invention; 
Figure 5 is a block diagram of a medium contrast web inspection system 
10 of the present invention; 

Figure 6a is a block diagram of a low contrast web inspection system of 

the present invention; 
Figure 6b is a block diagram of the multi-pipeline flaw detection pre 
processing block of the low contrast web inspection system of 
15 Figure 6a; 

Figure 7 is a block diagram of a print web inspection system; 

Figure 8 is an illustration of a web monitoring graphic user interface of the 

present invention; 
Figure 9 is an illustration of the web system software architecture of the 
20 present invention; and 

Figure 10 is a block diagram of a factory web inspection system. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

Figure 2 illustrates a smart camera approach to a web inspection system 
25 50 of a preferred embodiment of the present invention. The web inspection 
system 50 includes smart camera systems 60 for monitoring a web 52. Each 
smart camera 60 is connected to a host computer 58 through an ethernet hub 
62 utilizing standard ethernet cabling 64. The ethernet cabling 64 includes 
control lines for delivering control signals to the smart cameras 60 from the host 
30 computer 58, and image lines for sending defect images and information to the 
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host computer 58. Each smart camera 60 receives real-time control and 
synchronizing signals 68 from a web encoder 54 that monitors the speed and 
position of the web 52. The information from the web encoder 54 allows the 
smart cameras 60 to track the position of a defect along the length, or machine 
5 direction (MD), of the web. Control signals from the encoder ensure that the 
smart cameras 60 are synchronized in real time, and thus, provide synchronized 
images to the host computer 58. The position of a defect along the width, or 
cross direction (CD), of the web 52 is known by the identity of the camera 60 
sending the defect information. A marking system 56 for marking the web 52 

10 receives control signals from each smart camera 60 on a third control line 66. 
The third control line 66 is one of a set of general input/output control line that 
also may be utilized for receiving switch signal inputs, e.g. cut controls that signal 
when the web 52 will be cut The configuration of the web inspection system 50 
of Figure 1 may be expanded by the addition of smart cameras 60. 

1 5 Figure 1 0 illustrates an embodiment of the smart camera web inspection 

system 800 of the present invention integrated with a factory net 822. Each 
smart camera 804 monitors a section 806 of the web 814. Any number of smart 
cameras 804 may be connected and synchronized via a control signal 808 from 
an encoder 816 monitoring the speed of the web 814. The control signal from 

20 the encoder 81 6 is utilized by the smart camera 804 to determine the position of 
a detected flaw or defect on the portion of the web 806 that is monitored by the 
smart camera 804. Each smart camera 804 is connected via standard ethernet 
cabling 81 0 to an ethernet hub 802. One of the nodes 81 2 on the ethernet hub 
802 is a personal computer 818 having an operator interface that provides a 

25 control and monitoring means for the web inspection system 800. The web 
inspection system 800 is further connected to the factory network 822 for remote 
access 824, 826 and for printing reports 828. Devices such as alarms 820 may 
be connected to a control line 81 1 to provide automatic means for notifying the 
operator of flaws or defects that exceed a predetermined threshold. 
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Referring to Figures 1 and 2, the smart camera system of the present 
invention 50 integrates an acquisition sensor of the camera 22 or frame grabber 
module 24, a pipeline pre-processor 26, and an image analyzer processor 28 
of the prior art into a single smart camera box 60. Required bandwidth is 
5 minimized since only detected flaws and defects of the inspection and 
corresponding flaw position information are communicated to the host computer 
58 through ethernet outputs 64 to an ethernet hub 62. Thus, off-the-shelf 
ethemet cables 64 may be utilized between the smart cameras 60 of the present 
invention and an ethernet hub 62. 

10 The smart camera web inspection system 50 of Figure 2 has additional 

advantages over the prior art system of Figure 1. The lower number of 
components of the smart camera web inspection system 50 requires less factory 
floor space. In addition, all vision components are contained within a smart 
camera box 60, and are provided by single manufacturer thus alleviating 

15 compatibility, integration, and set-up problems. Because only flaw and defect 
information and images are sent to the host computer 58, the system bandwidth 
is not likely to be exceeded, and access to the flaw or defect data during system 
operation does not degrade system performance. Another advantage of the 
smart camera web inspection system 50 of the present invention is that more 

20 cameras 60 may be added to the system 50 without causing bottleneck 
problems on the ethernet 62, or at the host computer 58 which displays and 
processes the incoming flaw and defect data. The addition of cameras 60 does 
not require addition of pipeline vision processor circuit cards or image analyzer 
processors and the associated rack equipment as required by prior art 

25 configurations. 

Another advantage of the present invention is that the operator console, 
or host computer 58, may be located in any convenient location on the 
manufacturing floor since the length of the standard cables 64 do not have to be 
limited. Also, the reduced number of components of the web inspection system 

30 50 of the present invention eliminates the need for computer interrupts, memory 
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chip sets, and/or input/output conflicts that are associated with the use of extra 
integrated circuit boards and other components. 

Figure 3 illustrates a camera 100 hardware solution of the preferred 
embodiment for a web inspection system 50 as shown in Figure 2. A head 
5 board 1 02 continuously captures images of the web and sends a pixel signal 1 04 
to a processor board 106. The head board sensor of the preferred embodiment 
has 5150 maskable pixels to generate an image at an instant in time, and 
generates up to 40 million pixels per second. Each image is digitized and light 
corrected on the head board 102, and the digitized pixels 104 are sent to the 

1 0 processor board 1 06 for flaw detection. Pixels for detected flaws 1 08, as well as 
corresponding flaw data 110, is sent to the input/output board 112. The 
input/output board 112 further processes the data for transmission to the host 
computer. The defect image data 114, 124 is sent to a host computer via an 
output connection 132 over an ethernet cable. The I/O board 112 also 

15 receives/sends control information from/to an external device via control lines 
120, 122 connected to a control connector 130. A power supply board receives 
at least one supply voltage via a power connector 134, and converts the supply 
power to appropriate voltages 118 utilized by the camera 1 00 components. In 
other embodiments of the camera 100, data 114 and control information 120 is 

20 connected directly to the connectors 130, 132. 

Digitization of the web image inside the camera 100 provides zero pixel 
jitter, low noise, and no electronic aliasing. In prior art systems, a camera sensor 
senses each pixel element and outputs an analog signal. Because it is not 
obvious where each pixel starts and stops, a pulse must be utilized to indicate 

25 where a pixel line starts. Thus, if a small amount of skew of the sample or pulse 
occurs as a result of sending the analog signal down a cable, a processor may 
not be able to distinguish each pixel correctly, which causes jitter of the analog 
pixel data. In the present invention, the head board 102 captures the analog 
pixel signal 1 04, and digitizes them. In an alternate embodiment, the head board 
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sends an analog pixel signal 104 to the processor board 106. Since the 
digitizing takes place on the head board 102, there is little or no jitter. 

The camera 100 of the present invention also significantly reduces 
electronic aliasing, which is the "fuzztness" associated with a display of an image 
5 that occurs when insufficient data bits are available to represent each pixel. For 
example, a raw signal of an alternating black and white image has abrupt 
transitions. To gate a square wave in a digitizer on the other end of a cable, four 
times the bandwidth is needed to sample the signal. Depending on the flaw rate 
of the web, the volume of data that must be exchanged between the 

10 components of the prior art system may overload the system. Minimizing the 
amount of processed data reduces the resolution of the image of the web. The! 
present invention greatly reduces the volume of data because the web image 
data is processed in the camera, and only flaw or defect data is sent across the 
ethernet cable. For example, in the present invention, if a single flaw is 

15 represented by 4 kilo bytes, and one flaw per second is detected, then only 4 
thousand bytes of data per second are transferred to the host computer 58. The 
prior art systems are required to send the entire web image, which may be up 
to four orders greater in magnitude of data than the system of the present 
invention. For high web flaw rates, i.e., for increasing web flow speeds, the 

20 number of bits of data transmitted over the ethernet increases for the systems 
of both the prior art and the present invention. However, limiting data 
transmissions to flaws and defects and associated data, allows the use of 
standard cables in the preferred embodiment of the present invention. 

There are several web inspection categories including high contrast, 

25 medium contrast and low contrast web inspection, so named based upon the 
level of detectable contrast between the good material and bad material as 
compared to the web material color variation. In a high contrast web inspection 
system, the cameras are typically able to detect contrast variations of 6 
percent or more from the standard material (global color). A high contrast web 

30 inspection system may be utilized for applications such as the detection of 
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pinholes in plastic, scratches on metal, and bright or dark marks on rubber. A 
medium contrast web inspection system has a capability of detecting defects that 
have a 6 percent contrast difference from the local color variation of the web. 
The medium contrast web inspection system is capable of detecting defects in 
5 the presence of changing circumstances, e.g., scratches on metallic surfaces in 
the presence of normal variations in texture. A low contrast web inspection is 
capable of detecting defects and flaws with a contrast very close to the noise 
level of the signal. The low contrast web inspection system may be utilized for 
applications requiring detection of holes, streaks, or clumps in porous material 
10 and faint scratches on flat surfaces or the presence of normal variations in 
textures. 

Figure 4 illustrates a block diagram of a high contrast web inspection 
system 160. High contrast cameras 162, 170 are connected to a host computer 
164 via an ethernet hub 168. The high contrast camera 162 includes a line scan 

1 5 camera 172 for capturing a web image. A pixel signal of the image is corrected 
for lighting uniformity and pixel sensitivity 174. Lighting and pixel gain and/or 
offset is performed on a pixel by pixel basis utilizing known baseline values of 
lighting uniformity and pixel sensitivity. Unlike prior art systems, the present 
invention performs the correction immediately upon obtaining the image such 

20 that the flaw detection algorithms are receiving corrected data. 

Continuing with Figure 4, the corrected signal is processed for web edge 
detection 176. Tracking of the edge(s) of web is very useful in order to 
distinguish between a web flaw or defect and a web edge. Web edges may not 
be even along the length of the web, or may vary in thickness, and texture, etc., 

25 and/or the web may drift along the cross direction. Any of these conditions may 
result in false flaw detection. Thus web edge detection 176 is programmable to 
allow for web edge variations in order to avoid detection of false flaws. Various 
methods of web edge detection may include tracking the web edge and/or 
processing images to a pre-determined position from the tracked edge. Thus, 

30 as the web drifts or the web width varies, the image detection area will also vary. 
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ln another method, web edges may be ignored by determining an image 
detection width that will always fail within a drift allowance. For web materials 
that require flawless edges, the web edge detection 176 may be programmed 
for exact tolerances. I n addition , the web edge detection 1 76 may be bypassed 
5 completely if all potential flaw information is desired. 

Continuing with Figure 4, multi-level thresholding 1 82 is applied to the 
video signal received from the web edge detector 176. The multi-level 
thresholder 182 applies a compression technique on areas of the scanned 
image. Each line scan camera 172 scans an area of the web equal to a one 

10 pixel length by a pixel width in the cross direction of the web, which may be 
represented by a digital array. In a preferred embodiment, the multi-level 
thresholder 172 reduces the array to up to thirty-two groups of similar pixels. 
The multi-level thresholder 182 may be set to distinguish predetermined 
thresholds. For example, a grey scale having three groups may be utilized to 

15 categorize each pixel as acceptable, dark, and light. 

The group information from the multi-level thresholder 1 72 is sent to a run 
length encoder ("RLE") 1 84 to generate data regarding the location of the pixels 
that are on the leading and the following edge of a group. For example, a first 
group that exceeds a threshold, as determined by the multi-level thresholder 

20 172, may be identified as located on a first line number along the machine 
direction, and starting at pixel 1000 and ending at pixel 1010 along the cross 
direction. The RLE 184, which functions as a one dimensional blob detector, 
determines candidate areas for further processing, and does not make 
judgements as to whether a group is a flaw or a defect. 

25 The RLE 1 84 transmits the multi-level thresholder groups pixel signal and 

informational data 186, including the group numbers, the line number, and the 
start and stop pixel numbers, to the two dimensional (2D) blob detector 188. 
The 2D blob detector 188 and the 2D blob analysis 190 perform a connectivity 
analysis on subsequent scanned lines in the machine direction to determine 

30 whether groups with the same class touch and form blobs, and whether a streak 
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exists in the machine direction. In a preferred embodiment, the streak detection 
is performed in hardware in the 2D blob detector 1 88 because the streaks must 
be detected based upon adjacent pixels in the machine direction. The pixel 
signal and informational data 166 is sent to the 2D blob analysis 190 for further 
5 blob analysis performed in software. In other embodiments the division of 
responsibilities for analysis may vary between the 2D blob detector 1 88 and the 
2D blob analyzer 1 90. In yet other embodiments of the present invention, the 2D 
blob detection and analysis function 188, 190 may be combined. 

In the preferred embodiment, as shown in Figure 4, the linescan camera 

10 1 72, the lighting uniformity correction and pixel sensitivity correction 1 74, and the 
web edge detection are preformed on a head board 178. The multi-level 
thresholder 182, the RLE encoder 184, and the 2D blob detection 188 are 
performed on a field programmable gate array ("FPGA") 180. The preferred 
embodiment utilizes flash memory to update the software or parameters such as 

1 5 the lighting correction coefficient. Software tasks such as 2D blob analysis 1 90 
and inspect/reject analysis 194 are performed on a processor 196 inside of the 
smart camera 162. 

Continuing with Figure 4, 2D blob analysis data 192, including the 
bounding box data, the area, the length, the width and the aspect ratio, is 

20 analyzed according to a predetermined inspect/reject criteria 194 to determine 
whether each identified blob is a flaw or defect. The resulting data 1 98, including 
the position of the left and right edges of the web, and the bounding box, the 
area, the length , the width, the aspect ratio and the digitized image of the flaw 
are sent to the host computer 164 via the ethernet device 168. 

25 In a preferred embodiment, the various connections between the host 

computer 164 and the cameras 162, 170 i.e., the ethernet bandwidth allocation, 
are prioritized such that error and flaw feature data is given high priority and 
image data is given low priority. For example, the web inspection system 160 
prioritizes marking a flaw on the web before showing an image of the flaw. If 
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no or few flaws are detected on the web, then the bandwidth is available for 
other tasks such as to periodically transmit images of the good web product. 

The high contrast web inspection system 160, as shown in Figure 4, only 
utilizes a fixed threshold to classify individual pixels, e.g. gray scale pixels are 
5 compared to a threshold. However, when the contrast between good material 
and bad material is small, or if the web material has a large color variation, then 
the high contrast web inspection system 160 can no longer accurately and 
consistently detect flaws. For materials that have a tolerance range, such that 
the contrast of a flaw is relative to the surrounding background material as 

10 opposed to being an absolute value, a simple threshold evaluation can not be 
used. The medium contrast web inspection system 200 of Figure 5 illustrates 
a system that can detect up to a two percent contrast difference. 

Referring to Figure 5, similar to the high contrast smart camera 162 of 
Figure 4, the medium contrast smart camera 202 includes a line scan camera 

15 204, a lighting uniformity correction and pixel sensitivity correction 206, a web 
edge detector 208, a multi-level thresholder 216, an RLE encoder 21 8, a 2D blob 
detector and analyzer 222, 226 and an inspect/reject criteria 230. However, the 
medium contrast smart camera also includes a 2D background filter 212. The 
2D background filter 212 takes an average that represents good product over a 

20 distance of the web along both the cross and the machine direction, sets the 
multi-level threshold 216 at a percent deviation of the good product average. 
The 2D background filter utilizes the pixel data 21 0 for a sequence of scan lines 
from the line scan camera 204, and calculates a running average. The average 
at any given point in time, i.e., along the length of the web, becomes a reference 

25 for good product for the a region local to that average. Thus, the medium 
contrast web inspection camera 162 is capable of adapting to changing 
characteristics of the web. In a preferred embodiment, the area analyzed by the 
2D background filter is given by 2 n x 2 m , where n ranges from 0 to 8, and m 
ranges from 0 to 8. Thus, for n=0 or m=0, the 2D background filter is a two by 

30 two pixel area. 
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Continuing with Figure 5, the 2D averaged signal is subtracted from the 
unfiltered signal 210 utilizing an adaptive background subtraction 214. In a 
preferred embodiment of the present invention, the 2D background filter 212 and 
adaptive back ground subtraction 214 are implemented in hardware, e.g. on a 
5 field programmable gate array. The filtered one dimensional video from the 
adaptive background subtraction 214 is sent to the multi-level thresholder 216 
which groups the data for a scan line. In a preferred embodiment of the medium 
contrast web inspection camera 202, the multi-level thresholder utilizes up to 16 
designation groups. Upon completion of the inspect/reject criteria analysis 230, 

10 the flaw classifications and statistics, flaw dimensions, and image data 232 is 
transmitted to the host computer 238 from each medium contrast camera 202, 
236 via the ethernet hub 234. 

Figure 6A illustrates a low contrast web inspection system 300 of a 
preferred embodiment. The low contrast line scan cameras 302, 330 are 

15 capable of detecting a contrast between good web material and flawed web 
material that is very close to the noise level utilizing a multi-pipeline flaw 
detection pre-processor 310. A variety of filters used in conjugation with 
adaptive background subtraction, and a multiple of threshold detectors allow 
detection of very small changes in the web material. Materials requiring a low 

20 contrast detection include porous material and metallic surfaces. 

Continuing with Figure 6A a line scan camera 304 produces digital pixel 
line scan data that is corrected for lighting uniformity and pixel sensitivity 306. 
The edge of the web is detected 308 and the corrected digital pixel line scan 
data and web edge data 340 are transmitted to a multi-pipeline flaw detection 

25 pre-processor 310. Figure 6B is a block diagram of the pre-processor 31 0 of 
Figure 6A. Four programmable 2D filters, including a background filter 350, a 
machine direction streak filter 352, a cross direction streak filter 354 and a small 
flaw filter 356 process the incoming corrected pixel line scan data 340. Each 2D 
filter 350, 352, 354, 356 utilizes the corrected pixel data 340 to calculate running 

30 averages along a length and width of the web. The averages 400, 404, 406, 408 
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become references for good product for regions local to each average. In a 
preferred embodiment of the present invention the area averaged by the 2D 
background filter 350 and the small flaw filter 356 is given by 2 a x 2 b , where"a" 
ranges from 0 to 1 1 , and "b" ranges from 0 to 1 1 . Thus^fo^tli^^th^B" 
5 background^fiJter^o^ In a preferred 

embodiment, the 2D MD streak filter 352 averages an area given by 2 a x 2 b , 
where "a" ranges from 0 to 1 1 , and "b" ranges from 0 to 1 1 . The 2D CD streak 
filter 354 averages an area given by 2 a x 2 b , where "a" ranges from 0 to 1 1 , and 
"b" ranges from 0 to 11. Four adaptive background subtraction channels 
10 372,374,376,378 operate on the outputs of the filters by subtracting a portion 
402 of the background filtered signal 400 from the corrected signal 340, the MD 
streak filtered signal 406, the CD streak filtered signal 404, and the small flaw 
filtered signal 408. In alternate embodiments of the present invention, the 
number of filters may vary. 
1 5 Continuing with Figure 6B, four multi-group thresholders 358, 362, 364, 

368 group pixels for each output 390, 394, 396, 398 of the adaptive background 
subtraction channels 372,374,376,378. A fifth multi-group thresholder 360 
groups pixels for a portion 392 of the output signal 400 of the background filter 
350. In a preferred embodiment, each multi-group thresholder 358, 360, 362, 
20 364, 368 utilizes up to four groups. However, the number of threshold groups 
may vary according to specific applications as required. The output 380 of the 
single pixel flaw detector 358 may consist of single pixel errors such as holes. 
The output 382 of the uniformity detector 360 may consist of larger potential 
block flaws. The MD streak detector 362 and the CD Streak detector 364 detect 
25 narrow streaks in the machine direction and cross direction 384, 386, 
respectively. The small flaw detector 368 may be utilized to detect smaller 
potential block flaws 388. The multiple, multi-group thresholder detectors 358, 
360, 362, 364, 368 supply a plurality of video streams that may contain flaws and 
defects. Thus, priority logic 370 is utilized to apply thresholds and rules to the 
30 video streams 380, 382, 384, 386, 388. 
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Referring back to Figure 6a, the RLE encoder 312 generates start-stop 
pixel information for the detected prioritized flaws and defects 342, and sends 
the video stream and start-stop data 314 to the 2D blob detector 316. Upon 
completion of the 2D blob detection 316, 2D blob analysis 320, and the 
5 inspect/reject criteria analysis 324, the flaw classifications and statistics, flaw 
dimensions, and image data 326 is transmitted to the host computer 332 from 
each low contrast camera 302, 330 via the ethernet hub 328. 

Figure 7 illustrates a preferred embodiment of a print web inspection 
system 500 for detecting flaws and defects in printed webs. The print consists 

10 of discrete patterns applied by techniques such as offset printing, flexo-graphic 
printing. Applications are pharmaceutical label verification, poster board 
inspection, box inspection, and plastic bag inspection. Flaw detection is based 
upon template matching. As shown in the print web smart camera 502 of Figure 
7, the video stream from a line scan camera 504 is lighting and pixel corrected 

1 5 506 on a pixel by pixel basis. The edge of the web is detected 508 and the pixel 
and related data is input to a preprocessing pipeline 542. In a preferred 
embodiment, the web is checked for color registration 510. An orientation 
analysis 512 is performed for a new pattern based upon translation, rotation and 
stretch. Thus, if a web skews or stretches, software or hardware in the print web 

20 camera 502 can compensate for the distortion. The image is transformed 514 
to fit a golden template. A subtraction channel 518 subtracts the web image 
output of an image buffer 520 from an image in a template buffer 516. The 
resulting pixel stream is grouped in a multi-level thresholder 522, and RLE 
encoded 524. A 2D blob detection 528 and a 2D blob analysis 530 is performed 

25 on the grouped data 526. The results of the analysis are inspected based upon 
predetermined reject criteria 532. The resulting inspect/reject flaw analysis, flaw 
classification and statistics, flaw dimensions and image data 534 are transmitted 
via an ethernet hub 538 to a host computer 540. The host computer 540 then 
process the data and image streams from all of the print inspection cameras 

30 502, 536 that are connected to the ethernet 538. 
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Figure 8 illustrates the graphical user interface 600 ("GUI") for the 
monitoring software of an online web inspection system of a preferred 
embodiment as shown in Figures 6A and 6B. The GUI includes a pull-down 
menu bar 604 that provides access to stored files for web inspections, trend 
5 analysis, and web histories. A web map window 602 displays representations 
of the detected flaws in a machine and cross direction per a legend 610. A flaw 
window 612 shows a specific detected flaw as identified by the flaw information 
614 below the flaw window 612. A camera web window 608 shows an image of 
the moving web for each camera in the inspection system. Web data statistics 

1 0 602 are displayed for the current web. 

The trend analysis, available as an option on the menu tool bar 604, 
analyzes the detected flaws and defects by cross direction and frequency. 
Thus, if a particular flaw appears in the same cross direction position at regular 
machine direction intervals, then the monitoring software alerts the operator of 

15 a potential problem occurring on the web manufacturing line. The availability 
of the automatic trend analysis may permit root cause analysis, allowing 
diagnosis and elimination of flaw-producing mechanisms, resulting in significant 
savings to the web manufacturer. 

Figure 9 illustrates a host computer software architecture 702 for a web 

20 inspection system 700 of a preferred embodiment of the present invention. Three 
smart cameras 704, 706, 708 are connected to an ethernet hub 710 and 
transmitted 748 to the host computer 702. For ease of illustration, only three 
smart cameras are shown. However, the preferred embodiment may include any 
number of smart cameras, as required. Continuing with Figure 9, each camera 

25 704, 706, 708 sends video and data to a corresponding software block 736. 
Camera C1 704 is represented in software by a camera component 712 which 
generates a flaw queue C1 718, and event queue C1 720, and a video queue 
C1 722. Camera C2 706 is represented in software by a camera component 714 
which generates a flaw queue C2 724, and event queue C2 726, and a video 

30 queue C2 728. Similarly, camera C3 708 is represented in software by a 
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camera component 716 which generates a flaw queue C3 730, and event queue 
C3 732, and a video queue C3 734. 

A multi-camera component 738 ("MCC") combines information from each 
camera component 71 2, 714, 71 6 to form a single flaw queue, event queue and 
5 video queue. The multi-caimera component 738 sends the queue information to 
a controller 740. The video queue includes detected flaw image data as well as , 
good web image data when permitted by bandwidth availability. The flaw queue 
includes flaw information such as the location and type of detected flaws. The 
event queue includes other signals received by host computer including printer 
10 on or off signals, a "cut" signal from web, operator input, and status changes. 
A web agent 744 sends the flaw, event and video queue data to appropriate 
devices such as the graphical user interface 742. An SQL database 746 is 
available to receive and send information from/to the graphical user interface 
742. 

15 Although a preferred embodiment of the invention has been described 

above by way of example only, it will be understood by those skilled in the field 
that modifications may be made to the disclosed embodiment without departing 
from the scope of the invention, which is defined by the appended claims. 



20 

WE CLAIM: 
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CLAIMS 

1 . A system for web inspection of a web, the system comprising: 

2 a plurality of smart cameras, each smart camera for detecting a plurality 

of web flaws from a streaming video signal, each smart camera 

4 having means for generating flaw image data and flaw location 

data; 

6 a host computer for controlling the low contrast web inspection system 

and for accepting and displaying the flaw image data and the flaw 
8 location data; and 

an ethernet for connecting the plurality of smart cameras to the host 
10 computer. 

2. The system of claim 1 , wherein each smart camera of the plurality of smart 
2 cameras comprises: 

a line scan camera for generating a pixel representation of a portion of 
4 the web; 

a lighting uniformity and pixel sensitivity correction means for correcting 
6 each pixel of the pixel representation and for providing a corrected 

pixel representation; 
8 a web edge detector for detecting at least one edge of the web; 

a multi-pipeline pre-processor for filtering the corrected pixel 
10 representation, the multi-pipeline preprocessor generating a 

prioritized data stream of potential flaws; 
12 a run length encoder for generating location data regarding a location of 

each group of the potential flaws in a cross direction; 
14 a blob detector for generating block data regarding the location of blocks 

of the potential flaws along a machine direction; and 
16 an inspect/reject analyzer for determining actual flaw data from the 

prioritized data stream of potential flaws. 
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3. The system of claim 2, wherein the multi-pipeline processor comprises: 
2 a plurality of filters for averaging the corrected pixel representation over 

a distance of the web along a machine direction of the web; 
4 a plurality of adaptive background subtraction channels connected to the 

plurality of filters; 

6 a plurality of thresholders, each thresholder of the plurality of thresholders 

connected to an output of an adaptive background subtraction 
8 channel of the plurality of adaptive background subtraction 

channels, each thresholder for grouping a subtracted pixel 
10 representations; and 

a priority logic circuit for prioritizing the outputs of each of the plurality of 
12 thresholders. 



4. The system of claim 3, wherein the plurality of filters comprises: 
2 a background filter; 

a machine direction streak filter; 
4 a cross direction streak filter; and 

a small flaw filter. 



5. The system of claim 3, wherein the plurality of thresholders comprises: 
2 a single pixel flaw detector; 

a uniformity detector; 
4 a machine direction streak detector; 

a cross direction streak detector; and 
6 a small flaw detector. 
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6. The system of claim 1 , wherein each smart camera of the plurality of smart 
2 cameras detects the plurality of web flaws from the streaming video signal at a 

contrast approaching a signal noise level. 

7. A method for low contrast web inspection of a web, the method comprising 
2 the steps of: 

providing at least on smart camera for inspecting at least a portion of the 
4 web; 

generating flaw image data and flaw location data; 
6 transmitting the flaw image data and flaw location data over an ethernet; 

displaying the flaw image data and flaw location data. 

8. The method of claim 7, wherein the step of generating flaw image data and 
2 flaw location data comprises the steps of: 

generating a pixel representation of a portion of the web; 
4 correcting the pixel representation for a lighting uniformity and a pixel 

sensitivity; 

6 filtering the corrected pixel representation utilizing a plurality of filters; 

grouping the filtered corrected pixel representations to generate a 
8 plurality of potential flaw data streams; 

generating a prioritized data stream from the plurality of potential flaw 
10 data streams; 

generating cross direction location data regarding a location of the 
12 prioritized data stream; 

generating block data regarding the location of blocks of the prioritized 
14 data stream along a machine direction; and 

determining actual flaw data from the prioritized data stream of potential 
1 6 flaws utilizing the cross direction location data and the block data. 
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9. A method for generating a prioritized image data stream from a digitized 
2 video stream of a web, the method comprising the steps: 

averaging the digitized video stream over a distance of the web to 
4 generate an averaged background signal; 

averaging the digitized video stream over a distance of the web along a 
6 machine direction of the web to generate a filtered machine 

direction signal ; 

8 averaging the digitized video stream over a distance of the web along a 

cross direction of the web to generate a filtered cross direction 
10 signal; 

subtracting the averaged background signal from the filtered machine 
12 direction signal to generate a first pixel representation; 

subtracting the averaged background signal from the filtered cross 
14 direction signal to generate a second pixel representation; 

grouping the first and second pixel representations to generate at least 
16 two data streams of potential flaws; and 

prioritizing the at least two data streams of potential flaws to generate the 
18 prioritized image data stream. 
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